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DETAILED ACTION 

Continued Examination Under 37 CFR 1.114 

1. A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1 .17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on March 
16, 2007 has been entered. 

2. The amendment filed on March 16, 2007 has been received and entered. Claims 
1-83 are pending in this application. Claims 1, 12, 22, 31, 42, 52, 61, 69, and 78 are 
independent claims. On the amendment filed on March 16, 2007, claims 1,12, 22, 31, 
42, 52, 61 , 69, and 78 were amended. 

Response to Arguments 

3. Applicant's arguments filed on March 16, 2007 have been considered but are 
moot in view of the new ground(s) of rejection. 
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Claim Rejections • 35 USC § 101 

4. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition 
of matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

5. Claims 1-4, and 12-15 are rejected under 35 U.S.C. 101 because the claimed 
invention is directed to non-statutory subject matter. 

Referring to claim 1 , the claim in lines 13-14 recites "performing a determined 
action when the criterion is satisfied". It is not possible to ascertain what kind of action a 
determined action is and, as such, it is not possible to ascertain whether said 
determined action would produce tangible, concrete, and useful results. Therefore, 
Claim 1 fails to fall in the four statutory categories. 

This claimed subject matter lacks a practical application of a judicial exception 
(law of nature, abstract idea, naturally occurring article/phenomenon) since it fails to 
produce a tangible result. Specifically, the claimed subject matter does not produce a 
tangible result because the claimed subject matter fails to produce a result that is limited 
to having real world value rather than a result that may be interpreted to be abstract in 
nature as, for example, a thought, a computation, or manipulated data. 

Claims 2-4 depend on claim 1 and are therefore rejected under 35 U.S.C. 101. 

Referring to claim 12, the claim in lines 15-16 recites "performing a determined 
action when the criterion is satisfied". It is not possible to ascertain what kind of action a 
determined action is and, as such, it is not possible to ascertain whether said 
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determined action would produce tangible, concrete, and useful results. Therefore, 
Claim 12 fails to fall in the four statutory categories. 

This claimed subject matter lacks a practical application of a judicial exception 
(law of nature, abstract idea, naturally occurring article/phenomenon) since it fails to 
produce a tangible result. Specifically, the claimed subject matter does not produce a 
tangible result because the claimed subject matter fails to produce a result that is limited 
to having real world value rather than a result that may be interpreted to be abstract in 
nature as, for example, a thought, a computation, or manipulated data. 

Claims 13-15 depend on claim 12 and are therefore rejected under 35 U.S.C. 

101. 

Claim Rejections - 35 USC § 103 

6. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

7. This application currently names joint inventors. In considering patentability of 
the claims under 35 U.S.C. 103(a), the examiner presumes that the subject matter of 
the various claims was commonly owned at the time any inventions covered therein 
were made absent any evidence to the contrary. Applicant is advised of the obligation 
under 37 CFR 1 .56 to point out the inventor and invention dates of each claim that was 
not commonly owned at the time a later invention was made in order for the examiner to 
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consider the applicability of 35 U.S.C. 103(c) and potential 35 U.S.C. 102(e), (0 or (g) 
prior art under 35 U.S.C. 1 03(a). 

8. Claim 1-5, 7-11, 12-16, 18-21, 31-35, 37-51, and 61-72, 74-77 are rejected under 
35 U.S.C. 103(a) as being unpatentable over Jasinschi et al., (hereinafter "Jasinschi") 
(U.S. Patent Application Publication Number 2002/0164151) in view of Syeda-Mahmood 
(hereinafter "Syeda") (U.S. Patent Number 6701014). 

As per claim 1, Jasinschi teaches a method for performing an action (Jasinschi, 
Paragraph 001 1 , i.e., method for analyzing the content of videotaped multimedia 
presentations) and teaches the limitations: 

"accessing recorded information, the recorded information including information 
recorded during a presentation of source information" (Jasinschi, Paragraph 0027, i.e., 
FIG 1. illustrates a block diagram of an exemplary multimedia analysis system 100 for 
analyzing videotaped multimedia signals; and Paragraph 0033, i.e., Controller 130 
must identify the appropriate video images to be used to create a multimedia table 
of contents. An advantageous embodiment of the present invention comprises 
computer software 200 capable of identifying the appropriate video images to be used 
to create a table of contents for the videotaped multimedia material); 

"comparing the recorded information to a source document, the source document 
being separate from the recorded information and being determined to include 
information corresponding to at least a portion of the source information presented 
during the presentation" (Jasinschi, Paragraph 0042,. In the fourth stage, the video clips 
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that are a part of the lecture presentation ("lecture video clips") are segmented. The 
lecture video clips can be segmented by comparing them to the video sequences of 
the presentation slides, to the head-and-shoulder views of the lecturer, and to the 
static images; and Paragraph 0043, i.e., In an alternate advantageous embodiment of 
the present invention, an additional fifth stage of the coarse table of contents 
segmentation may also be performed. In the fifth stage, "combination" images are 
segmented. A "combination" image is an image that contains more than one type of 
image. For example, one type of combination image comprises a static image in which 
a video clip is superimposed on a portion of the static image. A second type of 
combination image comprises a video clip in which a static image is superimposed on a 
portion of the video clip. A third type of combination image comprises a video clip in 
which a presentation slide is superimposed on a portion of the video clip. Other types of 
combination images are also possible. If no combination images are present, then the 
fifth stage of the coarse table of contents segmentation is not necessary)] 

"determining whether a portion of the source document corresponds to a portion 
of the recorded information, such that a criterion is satisfied" (Jasinschi, Paragraph 
0042-0043). 

Jasinschi does explicitly teach the limitation: "performing a determined action 
when the criterion is satisfied". 

On the other hand, Syeda teaches the limitation: 

"performing a determined action when the criterion is satisfied" (Syeda, Column 2 
Lines 46-48, i.e., It is, therefore, an object of the present invention to match electronic 
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slides to their appearance in a video stream; Syeda, Figure 2 teaches criteria for 
matching electronic slides to their appearance in a video stream; Syeda, Column 5 Line 
65 through Column 6 Line 5 recites said criteria in details, i.e., FIG. 2 illustrates an 
embodiment of the invention that performs a method of extracting geometric slide 
features by converting images into gray images, 20; extracting edges of gray images, 
21; forming curves by connecting edges, 22; extracting corner features on the slide 
curves, 23; grouping curves into curve-groups of intersecting curves, 24; and 
designating a sequence of three consecutive features in curve-groups as slide basis 
triples, 25; and Column 1 Lines 21-25, i.e., Automatic methods of cross-linking and 
indexing multimedia information are very desirable in such applications, as they can 
provide an ability to respond to higher level semantic queries, such as for the retrieval 
of learning material relating to a topic of discussion). 

At the time the invention was made, it would have been obvious to person of 
ordinary skill in the art to combine the method of Jasinschi, which teaches comparing 
videotaped presentations to source presentations, with the method of Syeda, which also 
compares recorded information to source presentations and performs an action when a 
criteria is met, so that the combined method would comprise comparing recorded 
information to source presentations and perform a determined action when a criteria of 
comparison is met. One would have been motivated to so in order to provide cross- 
linking and indexing multimedia information (Syeda, Column 1 Lines 21-25). 



As per claim 2, Jasinschi in view of Syeda teaches the limitation: 
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"wherein the information in the recorded information comprises an image of 
information outputted from the source document" (Jasinschi, Paragraph 0042-0043, i.e., 
In the fourth stage, the video clips that are a part of the lecture presentation ("lecture 
video clips") are segmented. The lecture video clips can be segmented by comparing 
them to the video sequences of the presentation slides, to the head-and-shoulder 
views of the lecturer, and to the static images). 

As per claim 3, Jasinschi in view of Syeda teaches the limitation: 
"wherein determining the source document comprises comparing an image in the 
source document with the image of information outputted from the source document to 
determine if the image in the source document matches the image of information 
outputted from the source document" (Jasinschi, Paragraph 0042, In the fourth stage, 
the video clips that are a pan of the lecture presentation ("lecture video clips") are 
segmented. The lecture video clips can be segmented by comparing them to the video 
sequences of the presentation slides, to the head-and-shoulder views of the 
lecturer, and to the static images; and Paragraph 0043, i.e., In an alternate 
advantageous embodiment of the present invention, an additional fifth stage of the 
coarse table of contents segmentation may also be performed. In the fifth stage, 
"combination" images are segmented. A "combination" image is an image that contains 
more than one type of image. For example, one type of combination image comprises a 
static image in which a video clip is superimposed on a portion of the static image. A 
second type of combination image comprises a video clip in which a static image is 
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superimposed on a portion of the video clip. A third type of combination image 
comprises a video clip in which a presentation slide is superimposed on a portion of the 
video clip. Other types of combination images are also possible. If no combination 
images are present, then the fifth stage of the coarse table of contents segmentation is 
not necessary; Syeda, Column 2 Lines 46-48, i.e., It is, therefore, an object of the 
present invention to match electronic slides to their appearance in a video stream; 
Syeda, Figure 2 teaches criteria for matching electronic slides to their appearance in a 
video stream; Syeda, Column 5 Line 65 through Column 6 Line 5 recites said criteria in 
details, i.e., FIG. 2 illustrates an embodiment of the invention that performs a method of 
extracting geometric slide features by converting images into gray images, 20; 
extracting edges of gray images, 21; forming curves by connecting edges, 22; extracting 
comer features on the slide curves, 23; grouping curves into curve-groups of 
intersecting curves, 24; and designating a sequence of three consecutive features in 
curve-groups as slide basis triples, 25). 

As per claim 4, Jasinschi in view of Syeda teaches the limitation: 
"wherein the information from the source document comprises an image" 

(Jasinschi, Paragraph 0042-0043 and Syeda Column 2 Lines 46-48, Figure 2, and 

Column 5 Line 65 through Column 6 Line 5). 

As per claim 5, Jasinschi in view of Syeda teaches the limitation: 
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"wherein performing the action comprises performing the action using the image" 
(Syeda, Column 1 Lines 21-25, i.e., Automatic methods of cross-linking and indexing 
multimedia information are very desirable in such applications, as they can provide an 
ability to respond to higher level semantic queries, such as for the retrieval of 
learning material relating to a topic of discussion). 

As per claim 7, Jasinschi in view of Syeda teaches the limitations: 
"wherein determining if the criterion is satisfied comprises: associating 
information from the recorded information with the information in the source document; 
and associating the information in the source document with information for the 
criterion" (Jasinschi, Figure 4, i.e., TIME, TABLE OF CONTENTS, PRESENTATION 
SLIDES, and Paragraph 0030, i.e., Controller 130 creates a table of contents that 
displays information that summarizes the content of the videotaped multimedia material. 
The table of contents generally comprises a combination of video signals, audio signals, 
and text signals. The table of contents is capable of displaying (1) text, and (2) still video 
images comprising a single video frame, and (3) moving video images (referred to as a 
video "clip" or a video "segment") comprising a series of video frames, and (4) text 
transcribed from audio signals, and (5) any combination thereof). 

As per claim 8, Jasinschi in view of Syeda teaches the limitation: 
"wherein information for the criterion and action associated with the criterion is 
associated with the source document" (Jasinschi, Figure 4; Syeda, Syeda, Column 2 
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Lines 46-48, i.e., It is, therefore, an object of the present invention to match electronic 
slides to their appearance in a video stream; Syeda, Figure 2 teaches criteria for 
matching electronic slides to their appearance in a video stream; Syeda, Column 5 Line 
65 through Column 6 Line 5 recites said criteria in details, i.e., FIG. 2 illustrates an 
embodiment of the invention that performs a method of extracting geometric slide 
features by converting images into gray images, 20; extracting edges of gray images, 
21; forming curves by connecting edges, 22; extracting comer features on the slide 
curves, 23; grouping curves into curve-groups of intersecting curves, 24; and 
designating a sequence of three consecutive features in curve-groups as slide basis 
triples, 25; and Column 1 Lines 21-25, i.e., Automatic methods of cross-linking and 
indexing multimedia information are very desirable in such applications, as they can 
provide an ability to respond to higher level semantic queries, such as for the retrieval 
of learning material relating to a topic of discussion) 

As per claim 9, Jasinschi in view of Syeda teaches the limitation: 
"wherein the information associated with the source document is embedded in 
the source document" (Jasinschi, Paragraph 0030, i.e. text). 

As per claim 10, Jasinschi in view of Syeda teaches the limitation: 
"wherein the recorded information comprises information identifying the 
information in the source document that has been outputted" (Jasinschi, Figure 4). 
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As per claim 1 1 , Jasinschi in view of Syeda teaches the limitation: 
"wherein the recorded information comprises an identifier, wherein the identifier 
is used to determine the information in the source document" (Jasinschi, Figure 4, i.e., 
TIME, TABLE OF CONTENTS, PRESENTATION SLIDES, and Paragraph 0030). 

Claims 12, 13, 14, 15, 16, 18, 19, 20, and 21 are rejected on the same basis as 
claims 1, 2, 4, 3, 5, 8, 9, 10, and 11 respectively. 

Claim 31, 32, 33, 34, 35, 37, 38, 39, 40, and 41 are rejected on the same basis 
as claim 1 , 2, 3, 4, 5, 7, 8, 9, 10, and 1 1 respectively. 

Claims 42, 43, 44, 45, 46, 47, 48, 49, 50, and 51 are rejected on the same basis 
as claims 12, 13, 14, 15, 16, 17, 18, 19, 20,and 21 respectively. 

Claims 61, 62, 63, 64, 65, 66, 67, and 68 are rejected on the same basis as 
claims 1 , 2, 3, 7, 8, 9, 1 0, and 1 1 respectively. 

Claims 69, 70, 71 , 72, 74, 75, 76, and 77 are rejected on the same basis as 
claims 12, 13, 14, 15, 18, 19, 20, and 21 respectively. 

9. Claims 6, 17, 36, and 73 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Jasinschi in view of Syeda and further view of Boegelund et al., 
(hereinafter "Boegelund") (U.S. Patent Application Publication Number 2003/0101043). 

Referring to claim 6, Jasinschi in view of Syeda does not explicitly the limitation: 
"wherein performing the action comprises communicating a translated image to a 
device". 
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On the other hand, Boegelund teaches the limitation: 

"wherein performing the action comprises communicating a translated image to a 
device" (Boegelund, Paragraph 0042 and Figure 4, i.e. "the text is then translated to the 
new language" and Paragraph 0047). Boegelund teaches a method and system for 
translating slide presentations into different languages, wherein texts in presentation 
slides are translated from one language to another and displayed (Boegelund et al., 
Paragraph 0042 and Figure 4, i.e. "the text is then translated to the new language." and 
Paragraph 0047). 

At the time the invention was made, it would have been obvious to a person of 
ordinary skill in the to combine the method and system for translating presentation 
slides from one language to another as taught by Boegelund with the system and 
method of Jasinschi in view of Syeda so that the combined method and system would 
constitute the method of claim 4, wherein performing the action comprises 
communicating a translated image of the image to a device (Boegelund, Paragraph 
0042 and 0047 and Lin, Paragraph 0029-0031, i.e. "when the multimedia data object is 

replayed using a computer controllable display screen and an audio device "). One 

would have been motivated to do so in order to "have a method that can translate 
presentation slide information from one language to a second language in an efficient 
and accurate and cost-effective manner" (Boegelund, Paragraph 0014). 

Claim 17 is rejected on the same basis as claim 6. 

Claim 36 and 73 are rejected on the same basis as claim 6. 
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10. Claims 22-29, 52-59, and 78-82 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Jasinschi in view of Syeda and further view of Boegelund and further 
in view of Lin (U.S. Patent Application Publication Number 2004/0205477). 

As per claim 22, Jasinschi in view of Syeda and further in view of Boegelund 
teaches the limitations: 

"accessing recorded information, the recorded information including information 
recorded during a presentation of source information from at least one source document 
separate from the recorded information" (Jasinschi, Paragraph 0027, i.e., FIG 1. 
illustrates a block diagram of an exemplary multimedia analysis system 100 for 
analyzing videotaped multimedia signals; and Paragraph 0033, i.e., Controller 130 . 
must identify the appropriate video images to be used to create a multimedia table 
of contents. An advantageous embodiment of the present invention comprises 
computer software 200 capable of identifying the appropriate video images to be used 
to create a table of contents for the videotaped multimedia material)] 

"comparing a source document slide in the at least one source document to an 
image containing in the recorded information, a criteria being satisfied if the source 
document slide corresponds to the image" (Jasinschi, Paragraph 0042, In the fourth 
stage, the video clips that are a part of the lecture presentation ("lecture video clips") 
are segmented. The lecture video clips can be segmented by comparing them to the 
video sequences of the presentation slides, to the head-and-shoulder views of the 
lecturer, and to the static images; and Paragraph 0043; and Syeda, Column 2 Lines 
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46-48, i.e., It is, therefore, an object of the present invention to match electronic slides 
to their appearance in a video stream; Syeda, Figure 2 teaches criteria for matching 
electronic slides to their appearance in a video stream; Syeda, Column 5 Line 65 
through Column 6 Line 5 recites said criteria in details, i.e., FIG. 2 illustrates an 
embodiment of the invention that performs a method of extracting geometric slide 
features by converting images into gray images, 20; extracting edges of gray images, 
21; forming curves by connecting edges, 22; extracting corner features on the slide 
curves, 23; grouping curves into curve-groups of intersecting curves, 24; and 
designating a sequence of three consecutive features in curve-groups as slide basis 
triples, 25; and Column 1 Lines 21-25, i.e., Automatic methods of cross-linking and 
indexing multimedia information are very desirable in such applications, as they can 
provide an ability to respond to higher level semantic queries, such as for the retrieval 
of learning material relating to a topic of discussion), and 

"communicating a translated slide to a device when the criteria is satisfied, the 
translated slide including a translation of at least a portion of the source document 
slide," (Boegelund et al., Paragraph 0042 and Figure 4, i.e. "the text is then translated to 
the new language" , and Paragraph 0047). 

Jasinschi in view of Syeda and further in view of Boegelund does not teach the 
limitation: "whereby the device is operable to display the translated slide while 
accessing the portion of the accessed recorded information". 

On the other hand Lin teaches the limitation: 
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"whereby the device is operable to display the translated slide while accessing 
the portion of the accessed recorded information" (Lin, Paragraph 0028-0028, .i.e. 
"Synchronization of the overlaid replayable bitstreams..." ; and Paragraph 0029-0031, 
i.e. "when the multimedia data object is replayed using a computer controllable display 
screen and an audio device "). 

At the time the invention was made, it would have been obvious to a person of 
ordinary skill in the art to add the feature of displaying a slide while accessing the 
portion of the accessed recorded information to the method of Jasinschi in view of 
Syeda and further in view of Boegelund so that the resultant method would display 
translated slides while accessing the portion of the accessed recorded information. One 
would have been motivated to do so in order to produce a replayable recording of the 
real-time presentation (Lin, Paragraph 0006). 

Referring to claim 23, Jasinschi in view of Syeda and further in view of 
Boegelund and further in view of Lin as applied above with regard to claim 22 discloses 
the invention as claimed. Jasinschi in view of Syeda and further in view of Boegelund is 
directed to the method of claim 22, "wherein determining the translated slide comprises 
translating text of the source document slide to generate the translated slide" 
(Boegelund et al., Paragraph 0042 and Figure 4, i.e. "the text is then translated to the 
new language." and Lin, Paragraph 0028-0028, .i.e. "Synchronization of the overlaid 
replayable bitstreams..."). 



Application/Control Number: 1 0/661 ,052 Page 1 7 

Art Unit: 2162 

Referring to claim 24, Lin in view of Boegelund et al. as applied above with 
regard to claim 22 discloses the invention as claimed. Lin in view of Boegelund is 
directed the method of claim 22, wherein determining the translated slide comprises: 

"determining a storage location of the translated slide" (Boegelund, Paragraph 
0048, i.e. " storage and retrievaf); and 

"retrieving the translated slide from the storage location" (Boegelund, Paragraph 
0048, i.e. " storage and retrievaf). 

Referring to claim 25, Lin in view of Boegelund et al. as applied above with 
regard to claim 22 discloses the invention as claimed. Lin in view of Boegelund et al. is 
directed the method of claim 22, "wherein communicating the translated slide to a 
device comprises causing the translated slide to be displayed on the device" (Lin, 
Paragraph 0029-0031, i.e. "when the multimedia data object is replayed using a 
computer controllable display screen and an audio device "). 

Referring to claim 26, Lin in view of Boegelund et al. as applied above with 
regard to claim 22 discloses the invention as claimed. Lin in view of Boegelund et al. is 
directed the method of claim 22, "wherein communicating the translated slide to a 
device comprises storing the translated slide" (Lin, Paragraph 0029-0031, i.e. "when the 
multimedia data object is replayed using a computer controllable display screen and an 
audio device "). 
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Referring to claim 27, Lin in view of Boegelund et al. as applied above with 
regard to claim 22 discloses the invention as claimed. Lin in view of Boegelund et al. is 
directed the method of claim 22, "wherein the recorded information comprises an image 
of an outputted source document slide" (Lin, Paragraph 0025, 0027, 0033 and 0035). 

Referring to claim 28, Lin in view of Boegelund et al. as applied above with 
regard to claim 27 discloses the invention as claimed. Lin in view of Boegelund is 
directed the method of claim 27, "wherein determining the source document slide 
comprises comparing the image of the outputted source document slide to information 
in the source document slide to determine, if the image of the outputted source 
document matches the information in the source document slide" (Lin, Paragraph 0028, 
i.e. "For example, Fig. 1D shows a replayed slide corresponding to the captured image 
of the real-time slide presentation"). 

Referring to claim 29, Lin in view of Boegelund et al. as applied above with 
regard to claim 27 discloses the invention as claimed. Lin in view of Boegelund is 
directed the method of claim 27, "wherein the recorded information comprises 
information indicating that the source document slide in the source document has been 
outputted" (Lin, Paragraph 0025-0028 and 0033-0036). 

Claims 52, 53, 54, 55, 56, 57, 58, and 59 are rejected on the same basis as 
claims 22, 23, 24, 25, 26, 27, 28, and 29 respectively. 
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Claims 78, 79, 80, 81 , and 82 are rejected on the same basis as claims 22, 24, 
27, 28, and 29 respectively. 

11. Claims 30, 60 and 83 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Jasinschi in view of Syeda and further view of Boegelund and further in view of Lin 
and further in view of Smith (U.S. Patent Application Publication Number 
2004/0205601). 

Referring to claim 30, Jasinschi in view of Syeda and further view of Boegelund 
and further in view of Lin as applied to claim 27 above does not explicitly recite that 
slide number is used to determine the source document slide. However, Smith teaches 
a method and system for identifying, classifying, extracting and resolving hidden data in 
slides, wherein slide numbers are used to determine slides in a source document (Smith 
Paragraph 0073). 

At the time the invention was made, it would have been obvious to a person of 
ordinary skill in the art to add the feature of employing slide number to 
identify/determine slides in a source document as taught by Smith to the method and 
system of Jasinschi in view of Syeda and further view of Boegelund and further in view 
of Lin so that, in the resultant method and.system, the recorded information would 
comprise a slide number, wherein the slide number is used to determine the source 
document slide. One would have been motivated to do so simply because slide 
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numbers are used in the art to identify slides and that has been a well-known method in 
the art. 

Claim 60 is rejected on the same basis as claim 30. 
Claim 83 is rejected on the same basis as claim 30. 
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Conclusion 



. 12. The prior art made of record and not relied upon is considered pertinent to 
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